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I  INTRODUCTION 


There  has  been  little  work  done  to  automatically  discrim¬ 
inate  between  water  regions  and  shadow  regions  on  a  SAR  radar 
image  in  an  automated  procedure.  With  the  increasing  need  for 
analyzing  large  volumes  of  radar  data  by  computer,  however, 
this  becomes  an  important  recognition  task. 

In  areas  of  high  relief,  an  airborne  SAR  radar  image  cre¬ 
ates  many  radar  shadow  regions  which  may  be  confused  with  the 
water  regions,  since  both  water  and  shadow  regions  appear 
dark  and  with  subtle  differences  in  tone  and  texture.  This 
problem  could  be  resolved  by  an  additional  flight  line  having 
an  opposite  look  direction.  The  original  shadowed  regions  in 
the  new  flight  line  would  disappear,  and  the  water  regions 
would  still  remain  dark.  However,  this  solution  is  often 
impractical. 

In  this  report  we  describe  a  scene  analysis  system  which 
can  discriminate  between  water  and  shadows  by  using  contex¬ 
tual  information.  See  Figure  1.  The  techniqpae  is  based  on 
understanding  the  radar  reflectivity  which  is  related  to  the 
size,  shape  and  surface  material  of  the  terrain  illuminated 
by  the  radar  wave.  First,  the  statistical  textural  feature 
extraction  algorithm  is  used  to  extract  significant  features 
from  the  gray-tone  co-occurence  matrices  for  discriminating 
water  regions  and  shadow  regions  on  the  radar  imagery.  A 


I  INTRODUCTION 


1 


Maximum  Likelihood  Decision  rule,  which  incorporates  both 

e 

tonal  and  textural  features  into  the  labeling  process,  and 
an  adaptive  probabilistic  relaxation  algorithm,  which  incor¬ 
porates  the  contextual  information  into  the  labeling  process, 
are  then  applied  to  obtain  the  initial  labeling  and  to  im¬ 
prove  the  labeling  accuracy.  Second,  according  to  our  prior 
knowledge  of  the  water  regions  2uid  shadow  regions  on  SAR  im- 
agery,  a  relational  model  is  constructed  and  several  struc¬ 
tural  contextual  features  are  measured  to  create  the  symbolic 
description.  Then  a  spatial  reasoning  process  using  a  set 
of  structural  decision  rules  is  invoked.  Finally,  a  new 
interpretated  symbolic  image  is  generated  in  which  the  spec¬ 
ified  objects  (shadows  and  water)  are  clearly  identified. 
Before  doing  that,  some  preprocessing  such  as  requantization 
and  texture  preserving  noise  removal  may  be  applied  to  en¬ 
hance  the  useful  features. 

A  set  of  SAR  images  collected  over  Huntsville,  Alabauna  on 
17  June,  1977  and  another  set  collected  over  tne  Elizabeth 
City  area  on  10  October,  1980  have  been  processed  using  this 
system.  The  experiments  performed  show  that  the  two  level 
combination  discriminating  algori'thm  can  provide  significant 
capability  for  discriminating  the  water  regions  from  the 
shadow  regions.  Because  of  the  use  of  contextual  information, 
the  probabilistic  labeling  relaxation  improved  the  labeling 
result  on  the  pixel  level,  and  the  spatial  reasoning  method 
reduced  ambiguities  on  the  region  level  .  From  the  final  re- 
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suits  of  three  test  images,  we  can  see  that  most  of  water 
regions  and  shadow  regions  are  -identified  correctly.  We  will 
discuss  these  results  in  detail  in  Chapter* VI . 
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INPUT  IMAGE 


PREPROCESSING 

USING  A  CONTEXTUAL  DEPENDENT  MAT  FILTER 
FOR  TEXTURE  PRESERVING  NOISE  REMOVAL 


FEATURE  EXTRACTION 

USING  STATISTICAL  GCMT  MEASURING 
BASED  ON  TEXTURE  AND  GRAY  TONE  INFORMATION 


LOW  LEVEL  LABELING 

USING  ADAPTIVE  PROBABILISTIC  RELAXATION 
BASED  ON  PIXEL  LEVEL  CONTEXTUAL  INFORMATION 


SYMBOLIC  DESCRIPTION 

DEPTH  FIRST  REGION  ATTRIBUTES  MEASURING 
BASED  ON  REGION  LEVEL  CONTEXTUAL  INFORMATION 


OBJECT  INTERPRETATION 


USING  SPATIAL  REASONING 
BASED  ON  A  RELATIONAL  MODEL  AND  A  STRUCTURE 
DECISION  RULE 


OUTPUT  RESULT 


Figure  1.  Block  diagram  of  the  system. 
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II  CHARACTERISTICS  OF  SHADOW  AND  WATER  REGIONS  ON  SAR  IMAGES 


Most  of  the  practical  knowledge  of  radar  interpretation 
has  been  derived  from  studies  of  radar  images  including  the 
comparison  and  correlation  with  ground  truth  information  and 
aerial  photography. 

The  differences  of  tones  and  textures  between  water  and 
shadow  regions  on  SAR  imagery  are  depend  on  the  different 
ground  situations.  However,  these  differences  are  subtle. 

In  flat  terrain  area,  low  returns  are  received  from  sur¬ 
faces  atcting  as  specular  reflectors  having  surface  roughness 
much  leas  than  the  wavelength  of  the  radar(  less  than  X/10). 
Examples  are:  water,  pavements  and  dry  lakebeds.  Therefore, 
the  gray  tone  values  of  water  region  on  radar  imagery  are 
relatively  low  and  appear  prety  dark.  When  the  wind  is  still 
and  water  is  flat,  quiet-water  surfaces  are  near  perfact 
specular  reflectors.  In  this  case,  the  return  signal  will  be 
almost  zero.  As  a  result,  the  gray  tone  in  these  rgions  is 
completely  black.  It  is  just  like  that  in  ideal  shadow  re¬ 
gions  on  SAR  imagery. 

Textures  of  water  regions  on  SAR  imagery  usually  are  cre¬ 
ated  by  following  two  factors. 

In  the  open  water  areas  which  are  either  standing  or 
flowing  water  bodies  without  vegetation  covering  them,  the 
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surface  agitated  by  wind  backscatters  a  strong  radar  return 
which  can  be  called  the  "sea  return"  [1].  The  tonal  and  tex¬ 
tural  differences  of  the  open  water  area  on  the  SAR  imagery 
may  indicate  some  surface  wave  action.  Here  the  gray  tones 
corresponding  to  the  wavey  water  surface  form  the  texture  of 
the  water  region. 

Also,  there  is  the  case  of  the  floating  and  standing  veg¬ 
etation  which  may  cover  or  partially  cover  the  surface  of 
water  bodies.  This  makes  the  situation  more  complex,  since 
signals  returned  from  this  vegetation ' may  be  quite  varied. 
This  creates  another  kind  of  texture  in  water  regions.  It 
has  been  observed  that  the  darker  the  return  on  the  imagery, 
the  greater  the  amount  of  open  water  relative  to  the  vege¬ 
tation  {21. 

On  the  other  hand,  the  tones  auid  textures  in  shadow  re¬ 
gions  on  SAR  imagery  are  caused  by  following  factors.  When 
a  bright  return  occurs  from  hill  slopes  or  high  objects  fac¬ 
ing  the  radar  look  direction,  a  shadowed  region  on  the  far 
sides  of  the  crests  follows,  since  there  is  no  signal  re¬ 
turned  from  the  occluded  part  of  the  terrain.  Unlike  shadows 
in  aerial  photography  which  are  weakly  illuminated  by  energy 
scattered  by  atmosphere,  che  radar  shadow  is  completely  black 
and  sharply  defined.  If  there  is  no  noise,  then  an  ideal 
shadow  region  on  SAR  imagery  should  not  have  any  texture. 
Another  case,  however,  should  be  considered.  If  the  aircraft 
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reaches  a  position  such  that  the  farther  side  of  slope  of  the 
mountain  is  no  longer  behind  the  crests,  instead  of  the 
totally  black  shadow,  a  very  weak  signal  from  the  slope  faced 
away  from  radar  will  return.  The  corresponding  parts  in  the 
radar  image  appear  relatively  dark;  we  also  can  view  them  as 
shadows.  It  should  be  noted  that  an  intermediate  case  may 
occur  between  the  above  two  situations  so  that  the  shadow 
appears  partially  black  and  partially  relatively  dark.  This 
causes  variable  texture  patterns  so  that  it  is  difficult  to 
separate  it  from  that  of  water  regions. 

Moreover,  shadows  can  also  occur  on  the  water  surface 
when  the  waves  are  significantly  high.  While  the  tops  of  the 
crests  facing  the  radar  look  direction  yield  the  strongest 
signal  return,  the  absence  of  signals  is  from  the  far  slopes 
of  waves.  However,  these  shadow  regions  are  small  and  are 
within  the  water  area.  We  consider  the  waves  as  the  parts  of  a 
water  body,  so  they  should  be  eliminated  or  merged  into  the 
water  regions. 

Besides  the  aibove  tonal  and  textural  information,  there 
are  several  structural  features  which  are  very  helpful  for 
discriminating  between  water  and  shadows  on  SAR  imagery.  The 
first  thing  is  a  complex  signal  return  case  known  as  the 
"cardinal  effect".  This  is  a  result  caused  by  a  comer  re¬ 
flector  formed  by  the  combinations  of  two  flat  surfaces  at 
right  angle  to  one  another.  These  adjacent  smooth  surfaces 
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cause  a  double  reflection  that  yields  very  bright  "speckles 

e 

or  lines  on  the  SAR  imagery. 

Another  useful  structural  feature  exists  on  water  body 
boxindaries  on  SAR  imagery,  known  as  the  "Far  shore  brighten¬ 
ing  effect".  This  is  caused  by  the  smooth  water  area  with  a 
higher  beach  which  is  facing  the  radar  look  direction.  Since 
this  feature  usually  covers  only  small  areas  of  the  scene, 
they  often  appear  as  bright  lines  on  SAR  imagery.  For  this 
case,  the  dark  area  comes  first,  following  a  bright  linear 
feature  which  is  nearly  normal  to  the  radar  look  direction. 

Because  the  oblique  illumination  of  SAR  produces  strong 
returns  from  the  sides  of  ridges  and  peaks  facing  the  radar 
antenna,  this  makes  the  boundary  appear  very  bright  between 
shadow  and  shadow  making  objects  where  the  near  range  area 
of  the  boundary  is  not  flat.  In  most  cases,  these  bright 
linear  features  are  oriented  normal  or  nearly  normal  to  the 
radar  look  direction.  That  is,  the  bright  linear  feature 
comes  first,  «md  the  dark  region  follows  along  the  radar  look 
direction.  This  situation  is  just  the  opposite  to  that  of  a 
water  body  boundary. 

Another  property  of  shadows  in  SAR  image  is  that  the  radar 
illumination  becomes  more  oblique  in  the  far  range  direction 
and  shadows  are  proportionally  longer.  This  is  different  from 
the  constant  elevation  angle  of  solar  illumination  in  an  ae¬ 
rial  photograph.  However,  the  shadow  length  along  the  radar 
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look  direction  is  limited  to  a  certain  value  for  a  given  im¬ 
age,  since  the  height  of  shadow-making  objects  is  relatively 
small  compared  to  the  flying  height  of  the  airplane. 

From  the  above  analysis,  we  can  see  that  there  are  some 
tonal  and  textural  features  which  are  useful  for  discrimi¬ 
nating  water  and  shadows  on  radar  imagery.  In  some  cases-, 
however,  these  may  not  be  enough.  There  are  also  several 
structural  contextual  dependency  features.  This  structural 
information  can  be  also  incorporated  into  an  automated  radar 
image  processing  scheme.  The  remainder  of  the  report  dis¬ 
cusses  these  issues. 
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Ill  TEXTURE  PRESERVING  AND  NOISE  REMOVAL 


Because  both  water  regions  and  shadow  regions  in  radar 
images  are  not  rich  in  texture,  the  noise  will  tend  to  mask 
whatever  texture  there  is  and  make  the  recognition  task  more 
difficult.  Noise  in  radar  imagery  can  come  from  two  sources. 
One  is  radar  coherent  speckle  noise [  3  ],  the  other  is 
quantization  noise.  We  need  to  remove  this  noise  while  pre¬ 
serving  the  weak  texture  and  other  sxibtle  detail  information. 
This  kind  of  noise  removal  is  different  from  the  kind  which 
also  smooths  the  weak  texture  in  the  filtering  process. 

Unfortunately,  most  filtering  techniques  tend  to  wash  out 
the  weak  textures  that  we  want  to  use.  For  example,  the  SFILT 
which  we  developed  before  is  based  on  Lee's  refined  local 
statistics  method  which  removes  the  noise  along  edges  ac¬ 
cording  to  eight  different  kinds  of  edges.  It  was  pointed  out 
that  this  method  created  artifacts,  because  it  used  the  di¬ 
rectional  masks  in  the  filtering  process  [4].  Our  experiments 
confirm  that  it  preserved  the  sharp  edges  well,  but  it  washed 
out  detailed  texture  information.  In  fact,  the  SFILT  only 
used  a  weighted  average  method  in  which  the  weights  were  de¬ 
termined  by  one  directional  gradient.  The  multi- threshold 
adaptive  HTA  filtering  which  is  described  in  this  section 
uses  different  filtering  methods  according  to  the  local  ac¬ 
tivity  that  is  measured  by  a  generalized  gradient  function. 
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There  is  a  compromise  between  noise  removal  and  texture 
preservation.  Usually  a  filter  which  has  powerful  noise 
cleaning  capability  may  remove  or  spatially  distort  edge, 
line  and  texture  information.  In  contrast,  a  filter  which 
preserves  subtle  detail  will  tend  to  have  low  noise  cleaning 
capability.  Spatial  filters  attempt  to  balance  the  informa¬ 
tion  preserving  requirement  with  the  noise  cleaning  require¬ 
ment.  However,  the  balance  is  often  done  in  a  one-dimensional 
way.  For  example,  a  mean  filter  is  good  only  for  an  image 
which  consists  of  large  homogeneous  regions,  while  a  median 
filter  is  only  good  for  an  image  rich  in  sharp  edges  and  some 
impulse  noise.  Some  other  weighted  averaging  filters  may  be 
good  for  a  case  between  the  above  two  extreme  situations, 
are  problem  oriented.  A  real  world  image  consists  of  many 
regions  in  which  local  activity  varies  from  region  to  region. 
It  is  difficult  for  a  filter  optimized  for  one  kind  of  con¬ 
dition  to  work  well  in  amother.  Based  on  this  consideration, 
it  is  appropriate  to  design  a  method  in  which  several  simple 
filters  can  be  combined  to  form  a  more  efficient  and  more 
flexible  context  dependent  filter.  Thus  the  advantages  of 
each  can  be  ^preserved,  and  their  drawbacks  can  be  avoided  to 
get  an  optimal  effect. 

In  this  section,  we  describe  a  gradient  oriented  multi¬ 
threshold  adaptive  filtering  technique  for  the  purpose  of 
cleaning  noise  and  preserving  texture.  The  regions  of  an  Im¬ 
age  differ  In  their  local  texture  and  their  contrast.  There¬ 
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fore,  they  need  different  filtering  algorithms  to  balance  the 
noise  removal  against  the  texture  preservation.  The  filter¬ 
ing  that  we  discuss  is  region  dependent.  It  uses  a  general¬ 
ized  gradient  function  which  reflects  the  local  contextual 
information  as  a  cue  to  determine  the  nature  of  the  filtering 
for  each  local  neighborhood. 

The  algorithm  is  as  follows: 

(1)  First,  a  generalized  gradient  function  for  every  pixel 
is  computed. 

Let  be  the  pixel  gray  tone  value  to  be  filtered  and 
be  the  c  ’•responding  local  generalized  gradient  function 
within  a  N  X  N  window.  In  order  to  avoid  the  effects  of  random 
noise  in  computing  we  use  the  local  gray  tone  submean 

I 

instead  of  individual  pixel  value.  If  it  is  assumed  that 
the  size  of  any  noise  random  cluster  is  three  or  fewer 
pixels,  then  the  above  consideration  is  sufficient. 

Let  be  a  set  of  neighbors  of  pixel(i,j)  having  gray 

tone  intensity  Z^^ .  The  gray  tone  submeans  are  given  by 


f  g 

:  I 

s=q  r=p 


(4.1) 


where 

g  »  i  -  [  (N-1)  /  2  -  2  (k-1)  ) 
f  »  i  -  [  d-2{k-l)  ] 
p  «  j  -  (  (N-1)  /  2  -2  (d-1)  ] 
g«j-(d-2(k-l)  J 
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and  where  k,d  =  1,  2, 


•  •  •  # 


(  N  -  1  )/  2. 


Then  for  the  four  directions,  the  local  gradients  G  's  are 

9 

G°=  1  (  Uij  ♦  •  Mjj)  -  (  Mji  ♦  M32*  M33)  I  (4.2) 


O*''*-  I  (  Mji*  Mjj)  -  (  Mjj*  M33*  M33)  I  (4.3) 

8 

I  (  Mjj*  >*33)  -  (  M33.  M23*  M33)  I  (4.4) 

s 


I  (  M33.  *33.  M33)  -  (  Mjj*  M33*  M33) 


(4.5) 


and  the  final  gradient  is  proportional  to  the  sum  of 
the  directional  gradients 


G2.  a  C  I  G 


n'»/4 


1: 


naO  s 


(4.6) 


where  C  is  the  scaling  factor. 

The  resulting  G^j  is  a  good  measure  of  the  local  texture 
contrast. 

(2).  A  set  of  thresholds  can  then  be  applied  to  to 

detect  local  conditions  such  as  noedge,  weak  edges  or  ramp 
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edges  and  sharp  edges,  respectively.  The  choice  of  these 

e 

thresholds  may  be  determined  from  statistical  analysis  or  by 
examining  the  generalized  gradient  image  histogram.  These 
thresholds  give  the  processor  a  flexible  choice  for  different 
image  types  and  different  processing  purposes  [see  Fig.  3]. 
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A  thresholding  operation  is  used  to  determine  a  set  of 
zero-one  weights  according  to  the  value  of  such  that  the 
filtering  will  be  adapted  to  different  strategies 
m=l,2,...,  k  which  are  the  different  replacement  rules  for 
the  central  pixel  in  the  N  x  N  window. 

Strategy  is  chosen  if 


T  ,  <  G.  . 
m-1  ij 


m 


In  our 


experimeijts,  the  set  of  weight 


s  are  chosen  such 


that  the  filtered  pixel  value  W. .  is  given  by 

•  J 


w..  =  <  s,. 


i£  Tj 

1£  Tj  < 

"il 

i£(  G, ,>  T,)  AND 

1  J  J 

(max  gN-/4=  g° 
Ns  s 

OR  if  (  T2  < 

'^ij<  ^3) 

"ij 

if(  G. .  >  T.)  AND 

ij  j 

(max  # 

N  s 

(4.7) 


,0 

S 


where  is  the  output  of  a  5  by  5  averaging  filter  and 
is  the  output  of  a  7  by  7  sigma  filter! 4 1  and  is  the 
output  of  the  eight  edge  direction  weighted  £ilter[5]  and  M_ 
is  the  output  of  a  3  by  3  Median  filter[6]. 

As  a  result,  the  averaging  filter  is  only  applied  to  very 
homogenous  regions;  this  avoids  bluring  the  weak  texture. 
The  median  filter  is  only  applied  to  those  regions  which  have 
sharp  edges;  this  avoids  eliminating  the  lines,  small  objects 
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and  avoids  creating  artifacts  in  other  regions.  The  sigma 
filter  is  only  applied  to  those  regions  where  the  weak  tex¬ 
ture  preserving  is  more  important  than  perfect  noise  clean¬ 
ing.  Thus,  a  balanced  texture  preserving  and  noise  removal 
effect  can  be  simultaneously  achieved. 
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IV  STATISTICAL  LABELING  AND  ADAPTIVE  RELAXATION 

In  this  chapter  we  describe  a  statistical  labeling  algo¬ 
rithm  to  discriminate  the  shadow  regions  from  the  water  re¬ 
gions  on  radar  imagery  in  the  pixel  level. 

At  the  low  level,  we  first  have  to  extract  the  statistical 
parameters.  It  is  well  known  that  texture  is  an  important 
feature  to  characterize  and  discriminate  regions.  The  two 
major  texture  analysis  approaches  '  are  the  statistical  and 
structural  ones.  Since  the  texture  on  the  radar  image  does 
not  contain  any  very  regular  "texture  units"  and  their  spa¬ 
tial  arrangements  are  random,  the  statistical  approach  to 
extract  these  natural  texture  features  would  be  the  most  ap¬ 
propriate  way. 

A  variety  of  texture  analysis  methods  have  been  developed. 
They  can  be  found  in  1 12  , 13 ) .  One  of  the  most  widely  used 
method  is  the  gray-tone  co-occurrence  matrices  (  GTCM  )  pro¬ 
posed  by  Haralick  et  al.  [  7  ].  Because  human  beings  are 
sensitive  to  second-order  statistics  [  14  )  and  the  GTCM 
method  is  based  on  the  estimation  of  such  second-order  sta¬ 
tistics,  it  is  reported  that  the  GTCM  method  is  more  powerful 
than  the  other  methods  (  15  I .  The  GTCM  method  can  be  briefly 
summarized  as  follows: 

Let  f(x,y)  be  a  rectangular  digital  picture  and  let  N  be 
the  number  of  gray  levels  in  f.  The  GTCM  is  a  square  matrix 
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M  of  dimension  N  x  N.  The  (i,j)th  entry  in  M,  denoted  by-M^^, 
is  a  function  of  the  image  gray  tone  values  and  a  displace¬ 
ment  vector  d  =  (dl,  d2).  The  entries  are  the  unnormal¬ 
ized  counts  of  how  many  times  two  neighboring  resolution 
cells  which  are  spatially  separated  by  d  occur  on  the  image, 
one  with  gray  tone  i  and  the  other  with  gray  tone  j.  That  is 

”ij  ,  (m2,n2) )  I  f(mj^.n^)=i, 

f(ra2,n2)=j,  I  I  (m2 , n2 ) - (m^^ , n^^ )  M  =<i  )  (5.8) 

where  #  denotes  the  number  of  elements  in  the  set. 

Haralick  has  proposed  a  variety  of  measures  that  can  be 
used  to  extract  useful  texture  information  from  the  GTCM. 
Here,  we  choose  two  texture  features.  One  is  the  entropy  F^, 
the  other  is  inverse  difference  moment  .  They  are  defined 
by 


I  I  M.jlog( 


(5.9) 


1 

1  >  li  -  jl 


(5.10) 


The  average  entropy  has  a  higher  value  than  other  texture 
features  for  an  image  with  the  same  gray  tone  levels  [  7  ] . 
Since  this  measure  is  largest  for  equal  and  smallest  when 
they  are  unequal,  the  entropy  measure  is  useful  to  enhance 
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bright  linear  features  and  weak  texture  values.  The  useful¬ 
ness  of  the  inverse  difference  moment  texture  feature  for 


classifying  radar  image  segments  was  demonstrated  by 
Shanmugan  et  al  [8].  The  histogram  of  these  two  texture 
features  in  a  sampling  area  show  that  they  exhibit  a  Guassian 
distribution  shape.  In  one-dimensional  feature  space,  how¬ 
ever,  the  distributions  of  the  samples  of  water  and  shadow 
clearly  overlap.  This  indicates  that  a  single  parameter  may 
not  sufficiently  characterize  the  texture.  Therefore,  we  use 
the  gray  tone  value,  the  entropy  value  and  the  inverse  dif¬ 
ference  moment  value  as  three  measurements  to  form  a  three 
dimensonal  measurement  vector  X. 

By  examining  the  histogram  of  the  sample  of  the  above 
three  measurements,  these  data  appear  to  have  a  Gaussian 
distribution.  Thus,  the  Gaussian  Maximum  Likelihood  decision 
rule  can  be  used  for  the  initial  labeling  process.  It  assigns 
measurement  vector  X  to  class  if  and  only  if 

P  (  X  1  )  P  (  )  =  MAX  P  (  X  1  «  )  P  (  w  )  (5.11) 

P  P  P 

where 


P(X  |«^)  =- 


EXPl-  ---  (X-w^)^Z^‘^(X-Up) 1 


(2ir)N/2|z|V2 


is  the  class-conditional  density  function, 
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Wj.  =  E  I  X  I  1  is  the  class  conditional  mean  vector 
which  is  estimated  from  training  Scunples  for  class  u^. 

Ij.=  E  [  (  X  -  Up)  (  X  -  1 

is  the  class  conditional  covariance  matrix  which  is  estimated 
from  training  samples  for  class  and 

P  (  ■)  =  prior  probability  for  class  u^.  If  this  is 
unknown,  we  can  assume  that  all  prior  probabilities  are 
equal. 

In  order  to  improve  the  labeling  performance,  a  contextual 
classifier  using  a  non-degradation  adaptive  relaxation  algo¬ 
rithm  can  be  applied  to  the  radar  image.  Probabilistic  re¬ 
laxation  labeling  algorithms,  which  reduce  ambiguity  and 
noise  and  select  the  best  label  among  several  possible 
choices,  have  been  an  attractive  practice  in  many  types  of 
image  data  processing  [  16-18  and  10  ]. 

However,  unlike  simple  object  labeling  such  as  in  the 
tetrahedral  block  world  where  there  exists  a  small  niimber  of 
legal  labelings,  pixel  ladseling  in  radar  image  data  classi¬ 
fication  has  enormous  ambiguity  and  the  contextual  informa¬ 
tion  is  generally  not  known.  Furthermore,  in  pixel  labeling 
the  probabilistic  relaxation  procedure  generally  shows  a  de¬ 
gradation  after  several  iterations.  In  some  situations  the 
results  after  many  iterations  can  be  worse  than  the  initial 
labeling.  Since  the  number  of  iterations  for  minimum  error 
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is  unknown  in  advance,  there  is  a  potential  probles:  for  the 
use  of  probcUsilistic  relaxation  [  19  ] .  This  is  an  especially 

serious  problem  in  the  case  that  the  ground  truth  data  are 

« 

difficult  or  impossible  to  get. 

There  are  two  ways  to  solve  this  problem.  One  is  to  try 
to  extract  most  of  the  context  in  the  data  in  the  first  few 
iterations  so  that  the  initial  labeling  information  is  used 
in  a  sufficient  and  correct  manner.  The  other  is  to  try  to 
take  the  local  pixel  label  depedencies  into  the  relaxation 
labeling  process,  so  that  the  process  from  one  region  into 
another  cannot  get  out  of  hand.  Kalayeh  and  Landgrebe  [20] 
suggested  one  adaptive  labeling  method  using  the  weighted  sum 
neighbor  function  to  attempt  to  solve  this  problem.  Instead 
of  that,  we  describe  a  method  for  our  system  using  a  non- 
weighted  product  neighbor  function  in  which  the  compatibility 
coefficients  are  dynamic.  Consequently,  it  results  in  a  fast 
convergence  speed  and  a  better  accuracy  in  the  relaxation 
process.  We  initially  classify  the  pixels  probabilistically 
on  the  basis  of  certain  specific  features  and  then  iter¬ 
atively  adjust  the  class  probabilities  based  on  its  neigh¬ 
boring  probabilities  and  the  compatibility  of  the  context. 
The  procedur'.<s  are  as  follows. 

First,  we  compute  the  initial  probabilistic  labeling  which 
is  given  by  the  normalized  likelihood 

P  (  q^\  d^:  kCZ^(l))  =  P(  X  ) 
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P  (X  1  Wp)  p  («^) 

I  P  (  X  1  «p)  P  (Up) 


(5.12) 


In  the  above  formula,  we  use  the  notation  P(q^|d^: 
kez^(l))  to  denote  the  initial  IcLbeling  probaJsility  which  is 
the  probability  that  unit  i  takes  the  label  given  the 
first  level  context,  where  q^  corresponding  to  class  can 
be  each  class  from  the  set  Q  =  (w^^,  •••* 

the  measurement  made  of  unit  i  and  Z^=  {  1  }  indicates  that 
pixel  i  is  the  entry  unit  in  the  first  level  context  for  unit 
i  [9).  The  relaxation  begins  with  P(<3ild^'  kSZ^  (1)).  For 
the  sake  of  simplifying  notation,  we  will  denote  it  by 
P(qi,l). 

From  a  Bayesian  point  of  view,  let  us  consider  the  prob¬ 
abilistic  relaxation  algorithm  [9] 


P  (  q^/  t  )  Q  (  q^,  t  ) 


I  p  (q^.  t  )  Q  (  q. ,  t  ) 
^i 


where  P(qj^,t)  is  the  conditional  probability  that  unit  i 
takes  label  q^  given  the  t^  level  context,  and  Q(q^,t)  is 
the  t^  estimate  of  the  neighborhood  function  which  indicates 
the  degree  of  neighbor  support  for  that  conditional  proba¬ 
bility. 
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There  are  different  possible  combinations  for  the  support 
Q(q^,t)  which  the  neighbors  give  the  current  unit.  Typically 
we  have 

1)  the  weighted  sum  of  their  supports 


Q(q..t)=  I  D.  I  ?(q.\  d,^:  kSZ^  ( t)  )  J.  ^  (q.  i  q^  ) 


jeN(i)  q^ 


(5.14) 


2)  or  the  product  of  their  supports 


Q(q.,t)=  n  I  P(qji  d^:  k€2j ( t) ) J. ^ (q. ' q^ ) 
jeN(i)  q^ 


(5.15) 


where  N(i)  is  the  set  of  neighbors  for  unit  i,  and  0^  is 
the  total  influence  that  a  particular  neighbor  j  can  have  on 
unit  i,  and  d^  is  the  measurement  made  of  unit  i,  Z^(t)  is 
the  set  of  units  in  the  t^  level  context  for  unit  i,  and 
Jij(qiiqj)  are  the  compatibility  coefficients  which  represent 
the  compatibility  between  the  unit  i  with  the  laUsel  q^  and 
its  neighbor  with  the  label  q^  . 

The  compatibility  coefficient  the  key  term 

that  decides  the  extent  of  support  in  neighbor  function  Q 
(q^,t).  In  the  relaxation  process,  the  context  at  each  it¬ 
eration  grows  by  an  entire  neighborhood  width  surrounding  the 
previous  level  context.  The  initial  measurement  made  of  unit 
i  is  its  immediate  context.  The  neighborhood  context  for  unit 
i  is  the  measurement  d^  plus  all  the  measurements  of  units 
in  the  neighborhood  of  unit  i.  The  next  larger  context  for 
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unit  i  is  the  measurement  plus  all  the  measurements  of 
units  in  the  neighborhood  of  unit  i  plus  all  the  measurements 
of  units  in  the  neighborhood  of  the  neighbors  of  unit  i. 

Based  on  above  theory,  we  have  two  considerations  for  de¬ 
termining  the  compatibility  coefficients  j  (<3^  i ‘ij  )  •  is 
that  the  contextual  information  should  be  extracted  only  in 
the  fewest  number  of  iterations,  so  I ‘Ij )  should  be 
based  on  the  largest  reasonable  context  for  unit  i.  The  other 
is  that  we  should  insure  no  degradation  in  whole  process,  so 
the  compatibilty  coefficients  should  be  variad?le  and  data 
dependent  rather  than  a  constant  over  the  whole  data  set. 

The  problem  is  that  the  neghboring  patterns  of  every  pixel 
actually  are  unknown  to  us.  The  initial  probabilistic  label¬ 
ing  process  only  provides  an  estimate  of  the  identities  of 
neighboring  unknown  patterns.  This  estimate  which  is  based 
on  the  feature  measurements  also  has  some  uncertainties.  This 
is  why  the  initial  labeling  result  has  a  number  of  errors  and 
ambiguity.  If  we  compute  the  compatibility  coefficients  just 
using  the  single  pixel  estimate  in  the  nearest  neighbor  sys¬ 
tem,  the  initial  labeling  error  will  be  incorporated  into  the 
compatibility  coefficients.  This  will  cause  degradation  in 
relaxation  process.  One  way  to  solve  this  problem  is  to  use 
a  local  average  estimate  instead  of  a  single  pixel  estimate 
so  that  we  can  reduce  the  risk  of  using  the  incorrect  con¬ 
textual  information.  In  order  to  do  so,  we  make  two  assump¬ 
tions.  First,  we  assume  that  the  majority  of  the  initial 
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estimates  in  a  chosen  window  are  correct.  Second,  we  ass\jime 
that  there  exist  some  correlations  between  the  neighbors. 
These  assiimptions  are  true  in  most  cases. 

Therefore  we  compute  the  adaptive  compatibility  function 
(qj^l<3j)  in  the  following  way.  By  Bayes  formula 

P  (  qj) 

J.  .(q.  |q  )  = 
ij '^1 

P  (  qj) 

P  (  qi)  p  (  q^i  qi) 

. . . . i _ •  (5.16) 

P  (  qj) 

Using  the  local  average  estimate,  we  choose; 

1 

p  (qj)  . .  I  p  i^ez^d))  (5.17) 

IN  (j)|  aSN  (j) 

where  j  6  Nj^(i)  and  N^(i)  is  the  nearest  neighbors  of  unit 
i,  and  N  (j)  is  the  set  of  neighbors  surrounding  the  neighbor 
set  N^(i)  for  unit  i.  '  ♦ 

For  the  same  reason  we  choose 

1 

P  (qi)  . .  I  P  kSZjjCD)  (5.18) 

iNjC  i  )|  bCN^d) 
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where  N2(i)  is  a  set  of  neighbors  of  unit  i,  however, 
N^Ci)  is  the  second  order  neighbor  set  and  N^(i)  is  the 
nearest  neighbor  set.  Since  we  have  expanded  the  unit  i  to 
all  its  neighbors  b  in  order  to  estimate  PCq^^),  so  should  we 
also  consider  all  b's  neighbors  N(b)  when  we  estimate 
By  approximating  the  conditional  probability  we 

choose 

1 

p  (qjqi)  . .  s  itez  (D)  (s.is) 

J  ^  |N(b)|  c€N(b)  ^  ^ 

where  N(b)  is  a  set  of  neighbors  of  neighbor  N2(i)  for  unit 
i . 

The  relationship  between  these  neighbor  sets  are  shown  in 
Figure  3. 
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Flours  3.  Rttlationshlp  of  th«  nslghbor  sets. 


The  weighted  siun  neighbor  function  which  Kalayeh  and 
Landgrebe  use  does  not  reach  the  optimum  result.  Because  in 
adaptive  relaxation,  we  already  use  the  local  average,  it  is 
unnecessary  to  set  the  weights  to  adjust  compatibility  again. 
Furthermore,  the  situations  in  remote  sensing  data  are  com¬ 
plicated.  There  is  no  guarantee  that  setting  the  weights  can 
achieve  all  desired  effects  simultaneously.  In  fact,  we  can 
not  take  care  of  the  variety  of  different  cases  by  using  a 
single  set  of  weights  in  the  whole  updating  process.  Thus, 
the  weights  may  introduce  a  bias  effect  in  this  adaptive  re¬ 
laxation.  As  an  attempt  to  improve  it,  we  use  the  non- 
weighted  product  neighbor  function  in  which  the  compatibility 
coefficeints  are  adaptive  and  dynamic.  That  is 

8  (q^.t)  -  n  I  P(qjld^.  kszj(t)) 
jSNd)  q, 

where  i*  the  compatibility  coefficient 

ter  t  iterations.  It  is  computed  according  to  the  updated 
and  .  Because  there  is  no  degradation  in  adaptive  relaxa¬ 
tion,  <after  the  end  of  the  iterations,  we  obtain  more  context 
information.  Then  we  can  compute  the  new  compatibility  coef¬ 
ficients  which  reflect  the  new  accurate  relationship  between 
the  pixels  to  be  updated  further  and  its  neighbors.  Thus,  the 
compatibility  coefficients  are  further  adapted  to  a  new 
level.  This  technlc[ue  speeds  up  the  convergence  process.  In 
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order  to  compare  our  method  with  that  of  Kalayeh  and 
Landgrebe,  we  run  both  methods  on  the  same  data  and  find  that 
our  method  has  a  better  accuracy  in  fewer  iteration's. 

Using  the  above  technique,  we  compute  the  compatibility 
coefficients  J^j(t)  for  every  pixel  in  the  remote  sensing 
data.  The  immediate  context,  the  neigliborhood  context  and 
the  next  larger  context  are  measured  once  and  combined  into 
J^j(t).  As  a  result,  J^j(t)  slowly  varies  from  pixel  to  pixel 
and  from  iteration  to  iteration.  Then  a  non-weighted  product 
neighbor  function  Q(q^,t)  is  computed.  Finally,  we  assign  the 
pixel  to  that  class  which  has  the  highest  probability  after 
relaxation. 
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V  USING  A  RELATIONAL  MODEL  TO  REDUCE  AMBIGUITIES 


Relational  models  are  commonly  used  in  scene  analysis 
system.  One  important  use  of  relational  models  in  scene 
analysis  is  to  help  identify  an  unknown  object  that  has  been 
extracted  from  a  scene.  A  structural  description  of  an  un¬ 
known  object  can  be  constructed  and  compared  with  known 
structural  descriptions  to  determine  how  similar  they  are. 
The  organization  of  relational  models  for  scene  analysis  can 
be  found  in  [  21  ] . 

Since  some  objects  in  a  scene,  such  as  water  regions  and 
shadow  regions  in  SAR  image,  are  very  difficult  to  distin¬ 
guish  between  one  another  completely,  and  since  the  pictorial 
similarity  is  not  always  a  reliable  criterion  for  segmenting 
a  scene  into  regions  that  completely  correspond  to  the  object 
classes,  the  low  level  labeling  results  provided  by  the  sta¬ 
tistical  contextual  classification  may  be  incorrect.  Obvi¬ 
ously,  only  those  labels  that  can  be  derived  from  an 
arrangement  of  real  objects  in  the  scene  are  valid.  Proper¬ 
ties  of  objects  and  relations  between  them  imply  correspond¬ 
ing  properties  and  relations  of  the  SAR  image  regions  that 
result  from  these  objects.  These  projected  properties  and 
relations  contain  the  possible  labelings  of  regions  with  ob¬ 
ject  identification.  So  the  goal  that  we  try  to  achieve  here 
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is  to  just  use  high  level  contextual  information  to  verify 
the  objects  and  reduce  the  ambiguities. 

There  is  a  way  to  use  the  context  provided  by  the  more 
easily  recognized  objects  to  determine  other  objects.  More 
generally,  we  Ccui  use  the  spatial  or  contextual  relationships 
between  structural  features  or  primitives  provided  by  the 
statistical  classification  to  match  against  the  relational 
model  based  on  our  prior  knowledge. 

According  to  our  analysis  in  Chapter  II,  a  relational 
graph  model  for  discriminating  water  and  shadows  can  be  gen¬ 
erated  (  see  Fig. 4].  This  model  is  represented  by  an  abstract 
relational  structure  in  which  the  nodes  represent  regions 
labeled  with  their  property  values  and  the  arcs  represent  the 
relationships  among  regions.  Usually,  such  model  is  often 
very  difficult  to  formulate,  since  the  constraints  on  allow¬ 
able  property  values  and  relationships  are  hard  to  define. 
However,  the  results  that  we  have  from  our  low  level  classi¬ 
fication  provided  better  labeling  accuracy  than  a  simple 
segmentation  did.  Therefore  the  relational  graph  model  that 
we  need  is  much  simpler  than  the  usual  one.  From  Chapter  II, 
it  is  obvious  that  all  -shadow  regions  on  the  radar  image  re¬ 
sult  from  three-dimensional  objects  on  the  terrain  surface. 
These  objects  are  called  shadow-making  objects,  and  the  cor¬ 
responding  regions  are  called  shadow-making  regions.  Note 
that  a  shadow-making  object  is  not  necessarily  an  object 
which  is  in  shadow  on  the  image.  However,  it  causes  an  adja- 
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cent  object  to  be  in  shadow.  We  extract  the  shadow  and 


shadow-making  region  pair  in  two  steps.  First,  we  extract 
the  regions  which  are  adjacent*  in  radar  look  direction  to 
dark  regions.  Second,  we  select  the  regions  which  have  a 
long  common  boundary  with  a  neighboring  dark  region  in  the 
direction  away  from  the  radar  antenna.  If  the.  adjacent 
shadow-making  objects  are  not  flat,  then  the  extraction  of 
shadow-making  regions  becomes  simply  the  extraction  of  bright 
linear  features. 
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Figure  4.  Relational  graph  model:  for  water,  shadow 
and  others. 


According  to  the  relational  model,  a  set  of  decision  rules 
are  determined  as  follows: 
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Assign  a  region  to  shadow,  if  the  region  is  in  either  of 
the  following  two  cases: 

1)  A  region  which  is  assigned  to  shadow  by  the  low 
level  labeling  is  surrounded  by  other  non-water  regions. 

2)  A  region  which  is  assigned  to  shadow  by  the  low 
level  IcUseling  is  adjacent  to  bright  linear 
features  in  the  radar  look  direction. 

Assign  a  region  to  water,  if  it  is  in  one  of  the  following 
cases: 

1)  A  region  is  assigned  to  water  by  the  low 
level  labeling  is  adjacent  to  bright  linear 
features  in  the  radar  look  direction. 

2)  A  region  which  is  assigned  to  water  by  the 

a 

level  labeling  is  surrounded  by  other  non- shadow  re¬ 
gions. 

3)  A  region  which  is  assigned  to  water  by  the  low 

level  labeling  has  a  length  longer  than  the  specified 
limitation  of  shadow  length  along  the  radar  look  di¬ 
rection. 

4)  A  region  which  is  assigned  to  water  by  the  low 

•  level  labeling  has  some  vegetation  on  it. 

Assign  a  region  to  be  a  false  shadow  region  and  merge  it 
to  its  surround,  if  the  region  is  in  one  of  the  following 
three  cases: 

1)  A  region  which  is  assigned  to  shadow  by  the  low 
level  labeling  is  surrounded  by  a  water  region. 
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2)  A  region  which  is  assigned  to  shadow  by  the  low 
level  labeling  has  a  length  longer  than  the  specified 

limitation  of  shadow  length  along  the  radar  look  di¬ 
rection. 

3)  A  region  which  is  assigned  to  shadow  by  the  low 

level  labeling  is  between  a  water  region  and  some  other 
non- shadow  region. 

Assign  a  region  to  be  a  false  water  region  and  merge  it 
to  its  surround,  if  the  region  which  is  assigned  to  a  water 
region  by  the  low  level  labeling  is  surrounded  by  a  shadow 
region. 

For  the  above  relational  model,  the  shapes  of  water  re¬ 
gions  and  shadow  regions  are  arbitrary,  so  the  classical  re¬ 
gion  attributes  to  represent  an  object  such  as  medial  axis 
etc.  are  not  helpful  in  this  situation.  Also,  the  represen¬ 
tation  of  regions  by  circumscribing  boxes  is  not  suitadjle  for 
our  case,  because  sometimes  a  spurious  adjacent  or  surround 
relation  will  hold  between  boxes  of  two  regions,  while  in 
fact  it  is  not  true  of  the  regions  themselves.  We  choose 
several  structural  measurements  for  the  regions.  They  are: 
the  size  of  the  region;  the  relative  position  of  different 
adjacent  regions  along  the  radar  look  direction;  the  maximum 
length  of  the  region  along  radar  look  direction,  the  region 
state  ( interior  to  the  image  or  touching  the  boundary  of  the 
image)  and  the  n\imber  of  its  boiindary  pixels.  The  algo¬ 
rithm  for  measuring  these  spatial  relations  is  as  follows. 
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First,  the  region  indexes  of  the  symbolic  image  obtained 


from  low-level  processing  are  redefined.  Each  region  is 
identified  by  a  unique  region  identifier.  However,  in  the 
three  digit  index,  the  first  digit  represents  the  original 
low  level  labeling.  For  example,  the  water  region  index 
starts  from  100  and  the  shadow  region  index  starts  from  200 
etc..  Thus,  we  still  can  recognize  the  initial  assigned  label 
from  the  new  sequential  index. 

Second,  it  uses  a  linear  geometric  transformation  to  ro¬ 
tate  the  symbolic  image  to  a  possition  such  that  the  hori¬ 
zontal  scanning  line  is  parallel  to  the  radar  look  direction. 

Third,  it  scans  the  symbolic  image  line  by  line  in  the 
radar  look  direction.  If  the  scanning  line  meets  a  new  re¬ 
gion  label,  the  scanning  process  will  be  interrupted  and  a 
tracing  process  which  traces  the  region' s  external  boundary 
will  start.  We  describe  a  one-pass,  depth  first  boundary 
tracing  procedure  using  a  left  first,  clockwise  directed  four 
connected  neighborhood  search  technique  for  tracing  a  region 
boundary: 

1)  Record  the  coordinates  of  the  starting  point  of  the 
region,  keeping  the  region  always  on  the  right  side  of  the 
tracing  direction  and  trace  the  boundary  in  a  clockwise  di¬ 
rection. 

2)  For  each  successor,  detect  the  next  tracing  direction 
by  searching  the  same  label  from  the  four  connected  neighbors 
in  the  order  starting  from  the  left  side  of  previous  moving 
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direction,  then  the  front,  the  right,  and  finally  the  back 
[Figure  5], 

3)  Record  the  left  side  adjacent  region  label  and  its 
staring  position  and  end  position  in  the  tracing  process. 

4)  Count  the  number  of  pixels  of  the  region  boundary  in 
the  tracing  process. 

5)  Mark  the  region  state.  Mark  0  indicates  that  the  region 
is  completely  within  the  image.  Mark  1  indicates  the  region 
touches  the  image  boundary. 

6)  If  next  point=starting  point,  then  stop  tracing,  go  to 
step  7,  else  go  to  step  2. 

7)  Continue  the  scanning  process  from  the  break  point. 
Compute  the  maximum  region  length  along  radar  look  direction 
and  the  region  size, 

8)  Check  every  label  that  the  scanning  line  met  with  by 
means  of  a  hash  table.  If  the  region  has  been  traced,  go  to 
step  7,  else  go  to  step  1,  until  the  last  line. 
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Previous  moving  direction. 


Current  position 
Neighbors  to  search 


Figure  5.  Direction  and  order  of  searching:  previoxia 
moving  direction  (1)  left  to  right,  (2)  top 
to  bottom,  (3)  bottom  to  top,  (4)  right  to 
left. 
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The  high  Level  image  analysis  techniques  require  rapid 
access  to  region  information  and  to  the  relations  between 
regions.  For  every  region,  therefore,  the  region  attributes 
cuid  the  relations  of  adjacent  regions  (between  or  surround) 
are  stored  in  a  big  list.  And  a  hash  function  is  used  for  fast 
searching  and  accessing  to  this  structural  information.  After 
that,  a  property  file  which  contains  a  list  of  property  val¬ 
ues  for  the  above  measurements  can  be  created.  Then  the  spa¬ 
tial  reasoning  process  simply  becomes  a  table- look  up 
procedure  according  to  the  structural  decision  rule  described 
previously. 

To  simplify  the  algorithm  further,  it  is  necessary  to 
eliminate  many  small  regions  conposed  of  a  few  pixels.  This 
is  reasonable,  because  our  low  level  classification  based  on 
texture  features  is  a  local,  not  pointwise,  phenomenon.  It 
cannot  be  computed  reliably  for  small  regions  or  boundary 
cases.  As  a  result,  eimbiguities  may  occur  in  a  small  size 
of  object  and  the  boundary  region.'' 
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A  set  of  SAR  images  was  tested  using  the  system  described 
in  this  paper.  These  images  were  collected  over  Huntsville, 
Alabeuna  on  17  June,  1977  and  collected  over  Elizabeth  City 
area  on  10  October,  1980.  Because  the  initial  data  have  a 
very  wide  gray  tone  range,  we  quantized  the  data  into  64  or 
128  gray  tone  levels  for  convenience  of  processing. 

EXPERIMENT  1 

In  this  experiment,  a  set  of  basic  investigations  are 
carried  out  on  the  radar  image  data.  We  examine  the 
histograms  of  the  radar  images  in  the  different  cases.  In 
the  original  image,  the  gray  tone  values  spread  from  0  to 
65535,  but  most  of  them  are  within  the  interval  between  1400 
to  4000.  After  reguantization,  the  histogram  shows  that  the 
gray  tone  values  are  distributed  from  0  to  63  with  a  mean  21.6 
and  variance  328.  From  both  histograms,  we  see  that  their 
distribution  shapes  are  like  [  see  Figure  8  and  Figure  9]. 
Comparing  the  histogram  of  the  sampled  water  region  with  that 
of  the  sampled  shadow  region  [Figure  10  and  Figure  11],  we 
can  see  that  the  gray  tone  values  in  both  regions  are  very 
low  and  they  clearly  overlap  from  0  to  16.  However,  the  mean 
and  variance  of  the  sampled  water  region  are  lower  than  those 
of  the  sampled  shadow  region.  By  examining  the  histogram  of 
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texture  entropy  values  [figure  12],  we  see  that  it  has  a 
bimodal  shape  distribution.  The  left  mode  may  be  the  values 
of  possible  water  and  shadow  regions  and  the  right  mode  may 
be  that  of  others.  To  see  the  difference  of  entropy  value  in 
water  region  and  shadow  region,  we  examined  the  entropy  val¬ 
ues  in  both  regions  [Figure  13,  14].  The  result  is  that  they 
overlap  each  other  in  an  interval  between  44  to  75.  It  is 
different  from  the  gray  tone  histogreuns  in  that  the  entropy 
distribution  of  the  shadow  region  shifted  a  little  right  to 
that  of  the  water  region.  Meanwhile,  the  mean  and  variance 
of  entropy  of  shadow  region  are  also  greater  than  that  of 
water  region. 

Almost  the  same  situation  occurs  in  the  histogram  of  in¬ 
verse  different  moment  texture  values  [  Figure  15  to  17].  It 
is  noted  that  the  histogram  of  inverse  different  moment  in 
the  S3unpled  shadow  region  is  distributed  widely  from  44  to 
186.  This  means  that  it  overlaps  with  that  of  other  land  re¬ 
gions  also.  More  comparisons  were  made  by  examining  the 
histograms  of  texture  values  of  the  filtered  SAR  images 
[Figure  18  to  Figure  23].  The  results  show  that  the  differ¬ 
ences  of  mean  and  variance  of  texture  values  between  the  wa¬ 
ter  and  shadow  regions  in  the  filtered  image  are  greater  than 
that  of  those  regions  in  the  image  before  filtering. 

From  above  examinations,  we  conclude  the  following  prop¬ 
erties:  1)  the  requantized  image  almost  keeps  the  same  dis¬ 
tribution  shape  with  that  of  initial  image;  2)  the  histograun 
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of  the  sampled  water  region  clearly  overlaps  that  of  -the 
sampled  shadow  region  in  any  one-dimensional  feature  space  ( 
either  the. gray  tone,  entropy  and  inverse  difference  moment 
);  3)  the  histograms  of  three  features  in  the  filtered  image 
are  really  different  from  the  original  image,  although  this 
effect  can  not  be  seen  in  the  corresponding  gray  tone  images; 
4)  most  of  histograms  exhibit  a  Gaussian  like  shape. 

All  of  these  provide  useful  information  for  our  recogni¬ 
tion  task.  For  example,  point  2)  indicates  that  a  single  pa¬ 
rameter  may  not  sufficiently  discriminate  the  water  region 
from  the  shadow  region  in  a  radar  image.  This  is  further 
donfirmed  by  the  following  experiment  in  which  the  algorithm 
proposed  by  Davis  et  al[  14  ]  is  used.  We  extract  the  in¬ 
teresting  regions  by  1),  computing  texture  cooccurence  gray 
tone  levels,  2),  averaging  the  results,  and  3),  thresholding. 
The  results  show  that  this  procedure  can  not  discriminate  the 
shadow  from  the  water.  These  two  categories  are  mixed  [  see 
Figure  24  to  27  ) . 

Also,  the  bright  linear  features  present  in  the  radar  im¬ 
age  are  examined.  We  use  the  GTCM  to  segment  the  image  into 
three  categories.  The  first  category  consists  of  possible 
water  or  shadow  regions.  The  second  category  consists  of 
bright  features.  The  third  category  is  everything  else.  The 
GTCM  preserves  the  bright  lines  and  provides  a  structural 
feature  for  the  relationship  between  these  lines  and  the 
possible  water  or  shadow  regions  [  Fig. 28  to  Fig. 30  ] 
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EXPERIMENT  2 


To  show  the  effects  of  using  the  Multi-Threshold  Adaptive 
filtering,  several  SAR  images  were  processed  and  compared. 
The  corresponding  generalized  gradient  image  [  Fig. 32  ]  shows 
the  different  local  activities.  The  black  color  indicates  the 
lowest  local  activity  so  that  the  moving  average  filtering 
was  applied.  The  white  indicates  the  highest  local  activity 
so  that  the  Median  filtering  was  applied.  The  blue  and  the 
red  indicate  cases  between  above  two  situations  so  that  the 
Sigma  filtering  and  weighted  edge  filtering  were  applied, 
respectively.  Thus,  different  filtering  strategies  were  ap¬ 
plied  to  the  regions  according  to  the  generalized  gradient 
image.  It  seems  that  there  is  no  obvious  change  between  the 
original  image  [  Fig. 8  ]  and  the  filtered  image  [  Fig. 31  ]. 
Almost  every  thin  line,  fine  feature  and  basic  texture  in  the 
image  are  preserved.  However,  there  are  significant  changes 
that  we  can  see  from  the  textural  image.  It  is  clear  that  the 
entropy  and  the  inverse  difference  moment  computed  from  the 
filtered  image  are  different  from  that  of  the  original  one 
[Fig. 35  to  Fig. 38  ].  These  changes  are  due  to  the  removal 
of  the  noise.  The  interesting  thing  is  that  these  changes 
can  be  controlled  by  setting  different  thresholds.  Fig. 34 
shows  the  results  from  another  set  of  threshold  values.  The 
generalized  gradient  image  here  is  changed  and  it  turns  out 


VI . Experimental  results 


44 


that  more  details  and  weak  texture  would  be  preserved  in  this 
case. 

To  see  how  the  MTA  filter  improve  the  low-level  labeling 
result  more  obviously,  we  added  Gaussian  normal  noise  N(0,o*) 
with  different  a  values  to  the  SAR  images.  Then  the  seune 
statistical  classifer  as  we  described  in  Chapter  IV  were  ap¬ 
plied  to  the  noisy  image,  the  filtered  image  and  the  original 
image,  respectivelly. '  The  relative  classification  accuracy 
is  measured  by  comparing  them  with  that  of  original  image 
classification  [see  Table  1  to  Tabel  3  ]  .  It  can  be  seen  from 
these  results  [Figure  39  to  41]  that  the  labeling  accuracy 
of  the  image  filtered  by  MTA  filtering  is  much  better  than 
that  of  the  noisy  one.  Before  filtering,  almost  all  'the  wa¬ 
ter  regions  in  the  noisy  image  were  mislabeled  as  shadow  re¬ 
gions  and  some  shadow  regions  were  mislabeled  as  others  [see 
Figure  40).  However,  for  the  filtered  image,  the  labeling 
result  was  as  good  as  the  that  of  original  one  [  see  Figure 
41].  The  tedsles  show  that  the  relative  accuracy  can  be  im¬ 
proved  from  61.9  percent  to  92.2  percent  (with  noise  o  = 
10), even  from  65.5  percent  to  96.5  percent  (with  noise  o=5). 
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Table  1.  Contingency  tables  for  classification  results 
of  noisy  image  and  MAT  filtered  image 
(column  =  assigned  class,  row  =  true  class, 

WR  =  water,  SD  =  shadow,  OT  =  others  ). 

Scale  factor  for  the  number  of  pixels  =  100. 
Noise  0=10  for  the  noisy  image. 


*  overall  classification  accuracy:  ratio  of  the  number 
correctly  classified  pixels  to  the  number  of  total 
classified  pixels. 
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Table  2.  Contingency  tables  for  classification  results 
of  noisy  image  and  MTA  filtered  image 
(column  =  assigned  class,  row  =  true  class, 

WR  =  water,  SD  =  shadow,  OT  =  others). 

Scale  factor  for  the  number  of  pixels  =  100. 
Noise  0=5  for  noisy  image. 

*:  Overall  classification  accuracy. 


Table  2  (a)  Result  of  noisy  image 


class 

WR 

SD 

OT 

total 

Acc(%) 

WR 

64 

0 

2 

66 

7.1 

SD 

827 

142 

40 

1009 

86.1 

OT 

13 

23 

1511 

1547 

97.3 

total 

904 

165 

1553 

2622 

65.5* 

Table  2 

(b)  Result 

of  MTA 

filtered  image 

class 

WR 

SD 

OT  total 

Acc(%) 

WR 

875 

19 

1 

895 

96.7 

SD 

27 

132 

30 

189 

80.0 

OT 

3 

14 

1521 

1538 

99.9 

total 

905 

165 

1522 

2622 

96.4* 
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165  1552 


2622 


Table  3  (b)  Result  of  MTA  filtered  image 


class 


total 


ACC  {%) 


total  ^04 
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EXPERIMENT  3 


The  low  level  statistical  labeling  algorithm  is  examined 
in  this’ experiment.  Two  radar  images  which  definitely  contain 
water  regions  and  shadow  regions  are  chosen  as  the  test  data. 
In  the  first  image  [  Fig. 6  ],  the  shadows  are  created  by  high 
reliefs  (some  of  them  are  the  intermediate  case  described  in 
Chapter  II  ).  In  the  second  image  [  Fig. 48  ],  the  shadows 
are  made  by  the  high  flat  objects.  The  Gaussian  Maximum 
Liklihood  Classifier  is  applied  to  these  two  images.  The 
feature  space  for  classification  consists  of  gray  tone  value 
and  texture  values.  Then  'the  3 -dimensional  mean  vector  and  3 
by  3  covariance  matrix  are  estimated  from  the  training  sample 
set  [  Fig. 42  and  Fig. 52  ]  for  the  water  region  and  'the  shadow 
region  and  others,  respectively. 

The  texture  features,  both  entropy  and  inverse  difference 
moment,  are  extracted  from  the  GTCM  which  are  computed  for 
different  window  sizes  and  different  distances.  The  exper¬ 
iments  show  that  the  window  size  and  the  distance  of  GTCM 
have  significant  influence  on  the  accuracy  of  classification. 
An  unsuitable  window  size  and  distance  may  cause  an  incorrect 
texture  feature  extraction.  As  a  result,  ambiguities  on 
boundary  and  mislabeling  of  the  small  regions  will  occur  in 
the  result. 
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It  can  be  seen  in  classified  images  that  there  are  some 
land  regions  which  contain  the  water  regions  (  Fig. 43  and 
Fig. 55  ].  This  is  a  low  probability  event  and  probably  re¬ 
presents  a  classification  error.  Also  there  are  some  shadow 
regions  along  the  boundary  of  the  water  body  [Fig. 43].  This 
probably  represents  a  classification  error  too.  For  the 
first  image,  the  GTCM  with  a  window  size  12  by  12  and  a  dis¬ 
tance  6  (  Fig. 46  ]  produces  the  better  result.  For  the  second 
image,  the  classified  image  using  a  window  size  of  16  by  16 
and  a  distance  8  has  less  ambiguities  [  Fig. 57  ]. 

To  improve  the  overall  classification  accuracy,  the  adap¬ 
tive  relaxation  using  contextual  imformation  is  applied  to 
the  images  of  Figure  6  and  Figure  48.  The  initial  statis¬ 
tical  labeling  is  determined  by  the  normalized  maximum  like¬ 
lihood  estimate.  The  immediate  context,  the  neighborhood 
context  and  the  next  larger  context  in  the  initial  laQseling 
are  measured  once  and  combined  into  the  compatibility  func¬ 
tion.  Comparing  Fig. 43  with  Fig. 44,  Fig. 57  with  Fig. 58  and 
Fig  59,  'the  effect  of  reducing  the  ambiguity  in  the  shadow 
regions  is  obvious.  However,  we  can  not  expect  this  method 
to  chamge  the  classified  result  too  much,  since  the  initial 
labeling  error  can  influence  the  degree  of  the  improvement. 
Further  improvement  can  be  obtained  from  the  use  of  spatial 
relations  between  the  structural  features.  By  hvunan  inter¬ 
pretation,  however,  we  can  confirm  that  most  classified  re¬ 
gions,  either  water  or  shadow,  in  Fig. 44  amd  Fig. 59  are 
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correct.  In  other. words,  the  low  level  classified  results 
provide  enough  information  for  further  structural  recognition 
at  high  level. 

To  exeUttine  the  performance  of  adaptive  relaxation 
quantitatively,  a  set  of  LANDSAT  MSS  data  collected  from  the 
Roanoke  area  in  1979  were  tested.  The  initial  labeling  prob¬ 
abilities  for  3  classes  of  urban  or  built-up  land, agriculture 
and  forest  were  estimated  by  the  normalized  maximum  likeli¬ 
hood  method.  The  initial  non-context  labeling  results  [ 
Figure  61  )  were  obtained  by  using  Maximiim  Likelihood  Deci¬ 
sion  rule.  The  black  region  is  urban  or  built-up  land,  the 
white  region  is  the  agricultural  land,  and  gray  region  is 
forest  land.  The  corresponding  mean  and  covariance  matrix 
are  shown  in  table  4.  As  ground  truth  in  this  experiment,  we 
use  the  results  of  a  hand  segmentation  obtained  on  basis  of 
the  spectral  information  from  the  corresponding  aerial  pho¬ 
tographs  [Figure  62].  The  adaptive  relaxation  algorithm  with 
dynamic  compatibility  coefficients  were  applied  to  a 
block  of  150  X  150  pixels.  The  initial  error  of  this  block 
is  32.8  percent.  Within  three  iterations,  this  error  reduced 
to  25.2  percent.  This  experiment  clearly  shows  that  there 
is  no  degradation  and  most  improvements  of  labeling  accuracy 
are  obtained  in  less  than  5  Iterations  and  then  stabilized. 
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TABLE  4  The  Mean  and  Covariance 


Category  1  1116  pixels 


Mean 

Covariance 

Matrix 

23.507 

8.1442  6.3528 

1.7889 

-0.93896 

27.972 

12.665 

2.8140 

-2.2597 

43 . 950 

18.394 

20.999 

41.680 

31.051 

Category  2 

234  pixels 

Mean 

Covariance 

Matrix 

20.265 

■  4.0409  5.6659 

2.1560 

0.19782 

25.051 

18.117 

-0.05833 

-7.2051 

47.637 

25.223 

28.146 

48.415 

40.114 

Category  3 

533  pixels 

Mean 

Covariance 

Matrix 

15 . 448 

7.2605  12.586 

18.150 

20.816 

19.229 

29.182 

39.309 

46.316 

29.553 

59.118 

66.850 

30.298 

80.026 
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EXPERIMENT  4 


To  examine  the  performance  of  the  structural  recognition 
algorithm  described  in  Chapter  V,  two  symbolic  images  [Figure 
44  and  Figure  59 ]  obtained  from  the  low  level  labeling  of  SAR 
test  image  1  and  test  image  4  were  tested.  After  eliminating 
small  regions  and  redefining  the  region  index,  the  results 
are  shown  in  Figure  65  and  Figure  66.  The  radar  look  direc¬ 
tion  for  both  images  is  approximately  from  North  to  South  ( 
Top  to  Bottom),  so  we  rotated  the  images  90  degrees  before 
measuring  their  region  attributes  and  relations.  Using  the 
depth  first  tracing  strategy  described  in  chapter  V,  the 
structural  contextual  features  were  measured  and  the  corre¬ 
sponding  property  lists  were  created  [see  Table  5  and  Table 
61. 
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Table  5.  The  region  attributes  and  relations  list  for 

Figure  65.  (  R1  =  the  surrovinding  region  if  R2=0. 
R2  3  the  second  adjacent  region  that  is  not  in 
the  same  class  as  Rl.) 


Region  Region 
number  index 


Max.  Adjacent  State  Region  Boundary 

length  R  1  R2  mark  size  length 


1 

100 

416 

201 

0 

1 

7849499 

2 

101 

11 

209 

0 

0 

351 

3 

102 

25 

210 

0 

1 

2592 

4 

103 

65 

233 

0 

1 

85277 

5 

104 

11 

234 

0 

0 

336 

6 

105 

15 

235 

0 

0 

1113 

7 

200 

20 

300 

0 

1 

3515 

8 

201 

23 

100 

300 

1 

13587 

9 

202 

12 

100 

0 

1 

684 

10 

203 

IS 

100 

0 

1 

1928 

11 

204 

36 

302 

100 

1 

46843 

12 

205 

16 

300 

0 

0 

1476 

13 

206 

12 

100 

0 

0 

472 

14 

207 

18 

100 

0 

0 

1156 

IS 

208 

9 

302 

0 

0 

459 

16 

209 

32 

302 

0 

0 

12285 

17 

210 

22 

302 

102 

0 

3629 

18 

211 

11 

100 

0 

0 

494 

19 

212 

14 

302 

0 

0 

742 

20 

213 

9 

100 

0 

0 

344 

21 

214 

20 

302 

0 

•  0 

3387 

22 

215 

18 

100 

0 

0 

5184 

23 

216 

13 

100 

0 

0 

1680 

24 

217 

12 

302 

0 

0 

520 

25 

218 

18 

302 

0 

0 

2378 

26 

219 

16 

302 

0 

0 

848 

27 

220 

17 

302 

0 

0 

1670 
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Table  5  The  region  attributes  and  relations  list  for 
Figure  65.  (  continued) 


Region 

number 

Region 

index 

Max. 

length 

Ad j  acent 

R  1  R2 

state 

mark 

Region 

size 

boundary 

length 

28 

221 

10 

302 

0 

0 

606 

68 

29 

222 

11 

100 

0 

0 

475 

56 

30 

223 

8 

302 

0 

0 

384 

51 

31 

224 

44 

302 

0 

1 

12302 

291 

32 

225 

20 

100 

0 

0 

1686 

110 

33 

226 

19 

302 

0 

0 

1501 

105 

34 

227 

12 

302 

0 

0 

476 

53 

35 

228 

13 

100 

0 

0 

1717 

175 

36 

229 

21 

302 

0 

0 

2013 

100 

37 

230 

24 

302 

0 

1 

2339 

67 

38 

231 

9 

100 

0 

0 

371 

47 

39 

232 

20 

302 

0 

0 

1293 

92 

40 

233 

29 

302 

103 

1 

5713 

494 

41 

234 

23 

302 

0 

0 

6147 

194 

42 

235 

20 

302 

0 

0 

3343 

137 

43 

236 

9 

302 

210 

1 

329 

33 

44 

300 

169 

200 

0 

1 

805522 

968 

45 

301 

13 

201 

0 

1 

736 

61 

46 

302 

512 

204 

0 

1  12408839 

3917 

47 

303 

13 

201 

0 

0 

764 

47 

48 

304 

19 

207 

0 

0 

1911 

60 

49 

305 

27 

215 

0 

0 

5104 

114 

50 

306 

10 

216 

0 

0 

2368 

133 

51 

307 

47 

215 

0 

0 

15413 

237 

52 

308 

11 

204 

0 

0 

668 

51 

53 

309 

30 

225 

0 

0 

5590 

80 

54 

310 

10 

228 

0 

0 

2552 

140 
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Table  6.  The  region  arttributes  and  relations  list  for 

Figure  66.  (  R1  =  the  surounding  region  if  R2=0. 
R2  s  the  second  sdjacent  region  that  is  not  in 


the 

same  class 

as  R1 

.) 

Reg. 

Reg. 

Max. 

Adjacent 

state 

Reg. 

Boundary 

number 

index 

length 

R1 

R2 

mark 

size 

length 

1 

100 

319 

300 

204 

1 

9473378 

2318 

2 

101 

21 

300 

215 

1 

1156 

105 

3 

200 

21 

300 

100 

0 

6321 

439 

4 

201 

27 

100- 

300 

0 

10056 

543 

5 

202 

18 

300 

0 

0 

1002 

97 

6 

203 

15 

300 

0 

0 

731 

51 

7 

204 

35 

100 

300 

1 

28028 

927 

8 

205 

24 

300 

0 

0 

2053 

177 

9 

206 

23 

300 

0 

0 

5229 

229 

10 

207 

14 

300 

0 

0 

902 

100 

11 

208 

24 

300 

0 

0 

12269 

341 

12 

209 

16 

300 

0 

0 

707 

58 

13 

210 

22 

300 

0 

1 

7097 

376 

14 

211 

34 

300 

0 

0 

24349 

640 

15 

212 

21 

300 

0 

0 

4591 

203 

16 

213 

31 

300 

0 

0 

27296 

439 

17 

214 

17 

300 

0 

0 

848 

66 

18 

215 

32 

101 

300 

1 

26779 

406 

19 

216 

22 

300 

0 

0 

3786 

91 

20' 

217 

16 

300 

1 

2184 

83 

21 

300 

448 

200 

100 

1 

16166526 

2953 

i 
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For  image  1,  there  are  54  regions.  According  to  the  low 
level  labeling,  6  regions  were  assigned  as  water  regions,  37 
regions  were  assigned  as  shadow  regions  and  11  regions  are 
assigned  as  others.  For  image  2,  there  are  21  regions.  In 
the  low  level  labeling,  two  regions  were  assigned  as  water 
regions,  18  as  shadows  and  one  as  others.  From  Table  5,  we 
can  see  that  there  are  several  closed  water  regions  (e.g. 
region  2,  5,  6)  with  small  size  are  surrounded  by  shadows 
and  some  closed  shadow  regions  (e.g.  region  13,  14,  18,  20) 
are  surrounded  by  water  regions  and  some  shadow  regions  (e.g. 
11,  17,  40)  with  a  longer  maximum  region  length  in  radar  look 
direction  are  between  the  water  region  and  others.  (A  similar 
case  can  be  found  in  region  7  and  18  in  Table  6 . y 

By  the  structural  decision  rules  described  in  Chapter  V, 
which  is  based  on  the  real  world  model  described  in  chapter 
II,  all  these  regions  that  we  mentioned  above  are  misclassi- 
fied  and  should  be  Corrected.  Those  regions  with  region  state 
mark  1  are  treated  as  partial  regions.  We  are  not  sure 
whether  they  are  surrounded  by  other  regions  or  not.  So  we 
leave  them  alone.  Finally,  a  new  labeled  image  was  generated 
according  to  the  results  of  the  spatial  reasoning  using  the 
property  lists.  The  results  are  shown  in  Figure  67  and  Fig¬ 
ure  68.  Compared  to  the  results  of  low  level  classification, 
the  new  results  are  more  accurate.  In  a  final  experiment, 
the  mean  and  covariance  estimated  from  test  image  4  [Fiqrure 
52]  was  used  to  classify  another  image  [  Figure  69]  collected 
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in  the  same  period  and  over  the  same  area.  The  two  texture 
features  and  the  gray  tone  feature  are  used  as  before.  Using 
the  same  statistical  classifier,  we  got  the  low  level  label¬ 
ing  result  which  is  shown  in  Figure  70.  For  the  high  level, 
the  recognition  results  are  shown  in  Figure  71  and  Figure  72 
and  the  corresponding  property  list  is  shown  in  Table  7.  The 
results  indicate  that  the  high  level  recognition  using  the 
relational  model  can  reduce  the  ambiguity  so  significantly 
that  it  allows  the  low  level  recognition  procedure  to  be  more 
flexible.  It  provides  a  way  in  which  we  may  use  a  limited 
number  of  training  samples  in  one  image  to  recognize  objects 
in  a  set  of  radar  images  collected  in  the  same  condition. 
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Table  7.  The  region  attributes  and  relation  list 

for  figure  71.  (  R1  =  the  surounding  region 
if  R2=0.  R2=  the  second  adjacent  region  that 
is  not  in  the  sane  class  as  Rl.) 


Region 

number* 


Region  Max. 
index  length 


Adjacent  state  Region  Boundary 
Rl  R2  mark  size  length 


1 

2 

100 

101 

66 

21 

200 

303 

0 

203 

1 

1 

29282 

1652 

3 

102 

306 

201 

0 

1 

3938268 

4 

103 

21 

300 

227 

1 

1916 

5 

200 

24 

300 

100 

1 

7359 

6 

201 

75 

300 

102 

1 

201797 

7 

202 

32 

303 

0 

1 

11302 

8 

203 

21 

303 

101 

1 

3089 

9 

204 

18 

302 

0 

0 

1572 

10 

205 

19 

300 

0 

0 

1157 

11 

206 

25 

303 

0 

0 

3408 

12 

207 

16 

303 

0 

0 

2429 

13 

208 

22 

300 

0 

1 

5803 

14 

209 

16 

300 

0 

0 

1536 

IS 

210 

18 

303 

0 

0 

2495 

16 

211 

25 

303 

0 

0 

4546 

17 

212 

26 

300 

0 

0 

2637 

18 

213 

26 

300 

0 

1 

8456 

19 

214 

25 

300 

0 

0 

15246 

20 

215 

17 

303 

0 

0 

1593 

21 

216 

25 

303 

0 

0 

3293 

22 

217 

28 

303 

0 

0 

15058 

23 

218 

25 

303 

0 

0 

5555 

24 

219 

19 

303 

0 

0 

2813 

25 

220 

27 

303 

0 

1 

4162 

26 

221 

28 

300 

0 

1 

12511 

27 

222 

IS 

303 

0 

0 

3672 

28 

223 

34 

303 

0 

1 

9155 

29 

224 

29 

303 

0 

0 

14118 

30 

225 

26 

300 

0 

0 

3526 

31 

226 

19 

303 

0 

0 

3522 

32 

227 

12 

103 

300 

0 

2323 

33 

300 

373 

200 

103 

0 

6148748 

34 

301 

13 

201 

0 

1 

992 

35 

302 

34 

201 

0 

1 

17413 

36 

303 

36 

201 

101 

1 

9679777 
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Figure  6.  Test  image  1:  The  large  black  region  is  water 
and  the  several  small  black  regions  separated 
in  the  land  are  shadow  regions. 
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Figure  8.  Histogram  of  image  1 
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Flgura  11.  His’to^an  of  aantpled  shadow  arsa:  from  quan~ 
tizad  imaga  1. 
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Figure  13.  Histogram  of  texture  entropy  (s):  from  sam 
pled  shadow  area  of  quantized  Image  1. 
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Flgur«  14. 


Histogram  of  taxture  antropy  (w):  from  sam- 
plad  watar  araa  of  quantizad  imaga  1. 
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Figure  IS.  Hiatogrem  o£  inverse  difference 
moment (q):  from  the  quantized  image  1. 
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Figure  16.  Hlstograa  of  inverse  difference  moment 
(w) :  from  sampled  water  area  of  quantized 
image  1. 
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Flgur*  17.  Histogram  of  invarsa  dlffarant  momant 
(s):  from  samplad  shadow  araa  of  quantizad 
Imaga  1 


HXSTaCRAtl  OF 


H0U08F.  RCR 


PROBABILITY 
0.  2925  I 


sun  OF  FREQUENCIES  -  262144 

LOW  DATA  VALUE  -  O  HICH  DATA  VALUE  ■  209 

MAXIMUM  PROBAILITY  -  0.  214 
MEAN  ■  0.  822E+02  VARIANCE  ■  0.  370E+04 

FLA6S  SPECIFIED: H 


O.  2325 


0.  1725 


0.  1125 


0.  0525 


iiiiixiiiniiiixxxxiiiiiiiiiiixixiiiiiiiiiiiiixixixiiiiixiiii 

IIIXXIXIXX 
3  24  45  66  87  108  129  150  171  192 


DATA  VALUES 


histogram  of 


H0U08F.  RCS 


PROBABILITY 
O.  0385  I 


SUM  OF  FREOUENCXES  -  330 

LOW  DATA  VALUE  >  0  HIGH  DATA  VALUE  «  ] 

MAXIMUM  PROBAILITY  -  0.  033 
MEAN  ■  0.  7I9E+02  VARIANCE  ■  0.  191E+04 

FLAGS  SPECIFIED: H 


O.  0463 


0.  0343 


0223 


0.  0103 


. 

»* 

»  *« 
*•»**«« 


» 

*  * 
»  » 
«  * 


«« 


XIXXIIIIXIIIXIXXIXXXIXXIIIIXXXIIXXXXIIXIIIXXXXIXXIIXIIIIXIIXI 
IXIIXXXXXI 
2  20  38  36  74  93  111  129  147  163 


DATA  VALUES 


hxstocram  of 


H0U08F.  RCU 


PROBABILITY 
O.  6825  I 


SUM  OF  FREaUENCXES  -  5100 

LOW  DATA  VALUE  •  O  HIGH  DATA  VALUE  - 
MAXIMUM  PRQBAXLXTY  •  0.  662 
MEAN  -  O.  65aE-H}l  VARIANCE  -  0.  lESE-^OS 

FLAGS  SPECIFIED: H 


O.  5A25 


4025 


2625 


0.  1225 


XXXXXIXX1I2IXIIXII1IIIXXXIIIXIXXIII1IXIIIIIIIIIIII1IIIIZ1IXII 
0  9  18  27  36  45 

DATA  VALUES 


VI .Exparlm^ntal  results 
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from  MTA  filterod  Image  1. 
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Figure  22.  Histogram  of  inverse  difference 
moment (f2):  from  sampled  shadow  area  of 
quantized  image  1  . 
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Figure  23.  Histogram  of  Inverse  difference 
moment  (f3):  from  sampled  water  area  of  MTA 
filtered  image  1. 
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Figure  30.  Bright  linear  features:  _Whlte-  bright  .  lln' 
ear  features,  black'  possible  water  and  shad' 
ows,  blue-  others. 


Figure  32.  Generalized  gradient  image  (1):  Black-  for 
average  filter,  blue-  for  sigma  filter,  red- 
for  weighted  edge  filter,  white-  for  median 
filter. 
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VI . Experimental  reaulta 


Figure  34.  Generalized  gradient  image  (2);  Black- for 
•■varage  filter,  blue-  for  sigma  filter,  red- 
for  weighted  edge  filter,  white-  for  median 
filter. 
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Figure  37.  Entropy  Image  of  image  1:  Window  size’ 
1 ,  distances  2. 
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Flgura  40.  Labeling  result  (al):  fron  the  noisy  image 
with  noise  oslO.  Blue:  shadows.  Black:  wa¬ 
ter.  White:  others. 


VI . Experimental  results 


Figure  41.  Labeling  result  (a2):  from  the  correspond' 
Ing  MTA  filtered  image.  Blue:  shadows 
Black:  water.  White:  others. 


Figure  42.  Training  sample  set  for  image  1;  Brown 
water,  green  -  others, Yellow-  shadow. 
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Figure  43.  Labeling  result  for  image  1  (a):  With  tex¬ 
ture  computed  using  window  size  7x7,  dis¬ 
tance  1,  key:  black-water,  blue-  shadow  and 
white-others, the  classifier  is  a  Gaussian 
Maximum  Likelihood  classifier. 
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Figure  45.  The  mean  and  covariances  for  figure  46:  es¬ 
timate  from  sampling  set  in  fig  42. 


Figure  46.  Labeling  result  for  image  1  (b):  With  tex¬ 
ture  computed  using  a  12  x  12  window,  dis¬ 
tance  6,  and  Gaussian  Maxlm\im  likelihood 
classifier. 


Figure  47.  Labeling  result  for  image  1  (c):  Texture 

computed  using  a  20  x  20  window  ,  Distance 
4,  and  a  Gaussian  Maximum  likelihood 
classifier. 


Figure  48.  Test  image  4.:  Large  black  area  -water 
small  black  regions  on  land-  shadows. 


Flgura  51.  Inverse  dlfferen't  momen't  of  image  4:  tex 
ture  computed  using  a  16x16  window  and  dis 
tance  8. 


VI . Experimental  results 


Lab«Ilng  rssult  for  image  4  (a):  texture 
computed  using  a  S  x  5  window  and  distance 
2,  labeled  by  Gausian  Maximum  Likelihood 
classifier,  black-  water,  blue-shadow, 
white-  others. 


Flgura  54.  Labeling  result  for  iaage  4  (b):  texture 
computed  using  a  12  x  12  window  and  distance 
6,  labeled  by  Gaussian  ML  classifier.  Black- 
water,  blue- shadow,  white-others. 
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Figure  55.  Labeling  result  for  image  4  (c):  texture 

computed  using  a  10x10  window  and  ditance  4, 
labeled  by  Gaussian  ML  classifier,  black- 
water,  blue-shadow,  white-other. 
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Figure  56.  The  mean 
mate  from 

and  covariances  for  fig.  57: 
sampling  set  in  figure  52. 

Figure  57.  Labeling  result  for  Image  4  (d):  texture 

computed  using  a  16x16  window  and  distance 
8,  labeled  by  Gaussian  ML  classifier,  black- 
water,  blue-shadow,  white-other. 


Figure  58.  Relaxation  result  for  fig.  57  (a):  1  Iter 

atlon  using  adaptive  relaxation,  black 
water,  blue- shadow,  white-  other. 


Figure  59.  Relaxation  result  for  fig.  57  (b):  5  Iter' 

atlons  using  adaptive  relaxation,  black 
water,  blue'-shadow,  white  -  others. 


Figure  60.  Labeling  result  for  image  4  (e):  texture 
computed  using  a  20  x20  window  and  distance 
10,  labeled  by  Gaussian  Maximum  likelihood 
classifier,  black-  water,  blue-shadow, 
white-other. 
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Figure  64.  Labeling  result:  fourth  Iteration  using 
product  neighbor  function  and  dynamic  compat¬ 
ibility  coefficient.  Image  size:  150  x  150. 


VI . Experimental  results 


Figure  65.  New  Indexing  symbolic  image  1.:  Region 
nuffibers54,  categories:  water,  shadow  and 
others . 


VI . Experimental  results 


Figure  66.  New  indexing  symbolic  image  2.:  Region 
nuiDber3(21,  categories:  water,  shadow  and 
others . 


VI . Exp«rim«ntal  raaults 


Figure  69.  Test  Image  5:  Collected  in  the  same  condl 
tion  as  test  Image  4.  Image  size:  512  x  512 
quantization  level:  128. 


Figure  70.  Low  level  labeling  of  Image  5:  mean  and 
covariances  estimated  from  the  sampling  set 
In  test  Image  4,  l^Juivllng  method  Is  the  same 
as  that  for  Image  4.  Black:  water.  Blue: 
shadow.  White:  others. 
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Flgur*  71. 


Naw  Indaxing  symbolic  image  3:  Region 
nuinber»36,  categories:  water,  shadow  and  oth- 
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Figure  72.  Spatial  reasoning  result  3:  Black:  water 
Blue:  shadow.  White:  others. 


VII -CONCLUSIONS 


We  presented  a  scene  amalysls  system  for  identifying  the 
shadows  and  water  on  SAR  image  in  this  report.  All  exper¬ 
iments  done  have  shown  that  this  system  is  practical  for  our 
purpose.  From  the  final  results,  we  can  see  that  most  shadow 
regions  and  water  regions  were  identified  correctly. 

This  system  was  designed  so  that  it  used  the  contextual 
information  sufficiently,  wherever  in  the  preprocessing  ,  in 
the  pixel  level  labeling  or  in  the  region  level  reasoning. 
In  this  way,  it  overcame  the  specific  identification  diffi¬ 
culty  that  the  objects  to  be  discriminated  were  only  with 
subtle  differences  in  tone  and  texture. 

In  the  preprocessing,  we  described  a  region -dependent 
Multi -Threshold  Adaptive  filtering  technique  for  texture  pre¬ 
serving  noise  removal.  It  used  a  generalized  gradient  func¬ 
tion  which  reflected  the  local  contextual  information  as  a  cue 
to  determine  the  nature  of  filtering  for  each  local  neigh¬ 
borhood.  As  a  result,  a  balanced  texture  preserving  and 
noise  removal  effect  was  simultaneously  achieved. 

In  the  low-level  labeling,  we  discussed  a  probabilistic 
relaxation  algorithm  in  which  the  adaptive  compatibility 
coefficients  were  computed  by  local  average  estimate  and  were 
dynamic  in  the  whole  updating  process.  It  extracted  most 
contextual  information  in  pixel  level  just  in  the  fewest 
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nxunber  of  iterations.  Results  show  that  it  successfuly  re¬ 
duced  the  labeling  error  in  less  than  5  iterations  cuid  then 
stabilized.  There  was  no  degradation  in  the  entire  re¬ 
laxation  process. 

In  the  high-level  spatial  reasoning,  the  relational  graph 
model  based  on  our  prior  knowledge  of  water  and  shadow  re¬ 
gions  on  SAR  imagery  was  constructed.  The  corresponding 
structural  decision  rules  were  derived  from  the  relational 
model.  To  measure  the  contextual  information  in  the  region- 
level,  we  described  a  one-pass,  depth  first  boundary  tracing 
procedure  using  a  left  first,  cloclcwise  directed  four  neigh¬ 
borhood  search  technique.  Using  this  method,  a  property  file 
which  contained  a  list  of  region  attributes  and  region  re¬ 
lations  was  created.  Then  a  spatial  reasoning  procedure  was 
performed  according  to  the  set  of  structural  decision  rules. 
It  reduced  the  errors  euid  ambiguities  resulted  from  low-level 
labeling  significauitly.  The  most  false  shadow  regions  and 
water  regions  were  identified  and  corrected. 
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